Music/voice separation using the 2D Fourier Transform

Prem Seetharaman, Fatemeh Pishdadian, Bryan Pardo

This page shows a few audio examples for a source separation approach based on the 2D Fourier Transform.

from nussl import AudioSignal, FT2D
from audio_embed import utilities
import matplotlib.pyplot as plt
%matplotlib inline

mix = AudioSignal('audio/blondiecallme.mp3')
separator = FT2D(mix)
separator.run()
bg, fg = separator.make_audio_signals()
plt.figure(figsize=(20, 10))
separator.plot(None)
plt.tight_layout()
plt.show()

utilities.multitrack([(fg, 'Foreground'), (bg,  'Background')])

To select a source, toggle the associated radio button. To mute a source, toggle the associated mute button. To hear the entire mixture, toggle the associated radio or mute button once again (deselecting it).

mix = AudioSignal('audio/mysharona_solo.mp3')
separator = FT2D(mix)
separator.run()
bg, fg = separator.make_audio_signals()
plt.figure(figsize=(20, 10))
separator.plot(None)
plt.tight_layout()
plt.show()

utilities.multitrack([(fg, 'Foreground'), (bg,  'Background')])

mix = AudioSignal('audio/canthelpfallinginlove.mp3', duration=30)
separator = FT2D(mix)
separator.run()
bg, fg = separator.make_audio_signals()
plt.figure(figsize=(20, 10))
separator.plot(None)
plt.tight_layout()
plt.show()

utilities.multitrack([(fg, 'Foreground'), (bg,  'Background')])